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(54) Image synthesizer and apparatus for playing game using the image synthesizer 

(57) An image synthesizer capable of displaying an image of a three-dimensional object with a small number 
of polygons in real time with a high resolution. The information bout a three-dimensional object is stored in an 
object data storage (26) as object information for displaying the object using a plurality of shape models of 
different accuracies. The object information accuracy of shape modles is higher as the distance between the 
viewpoint of a viewpoint coordinate system and the three-dimensional object is shorter. The texture 
information attached to the polygons of the shapes is stored in a texture information storage (32) as image 
information having different resolutions according to the shape models and the polygons constituting the 
shape models. An image forming part (34) synthesizes an image to be displayed by mapping the texture 
information of accuracies corresponding to the polygons of a three-dimensional object on the polygons of the 
object generated by a three-dimensional arithmetic part (22) by transformation of perspective projection, and 
displays it on the display (40). 
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TITLE OF THE INVENTION 
IMAGE SYNTHESIZING SYSTEM AND 
GAME PLAYING APPARATUS USING THE SAME 

TECHNICAL FIELD 

5 The present invention relates to an image synthesizing 

system using the texture mapping technique and a game playing 
apparatus using such an image synthesizing system. 
BACKGROUND ART 

Conventionally, an image synthesizing system for 

10 synthesizing a pseudo three-dimensional (3-D) image through a 
computer graphic technique is known. Such an image 
synthesizing system is broadly used as in various video games, 
airplane and other vehicle maneuvering simulators. 

Fig. 12 shows the principle of such an image synthesizing 

15 system. The image synthesizing system previously stores image 
information relating to a 3-D object 310 in a virtual 3-D 
space 300. The image information relating to the 3-D object 
310 previously stored in a memory as a shape model comprises 
a plurality of polygons (1) to (6) (polygons (4) to (6) are 

20 not shown) . 

If the image synthesizing system is used in a driving 
game, the 3-D object 310 may be in the form of a racing car 
which moves in the virtual 3-D space 300 while competing with 
a player's car or in the form of a stationary matter such as 

25 a road, house or the like which is disposed in the virtual 3-D 
space . 

When a steering wheel or the like in a control panel 314 
is maneuvered by a player 312, the view point of a driver 
(player) which is set in the virtual 3-D space 300 
30 corresponding to the player's car is varied in position and 



direction. 3-D objects representing the racing car competing 
with the player's car and the surrounding matters are 
perspecti vely projected on a perspective projection screen 316 
of view-point coordinate system and displayed as a pseudo 3-D 
image 318. Thus, the 3-D objects including the racing car and 
other matters can be rotated and translated in real time by 
the player 312 to perform a simulation in the virtual 3-D 
space while viewing it from the driver (player). 

There is also known an improved image synthesizing system 
using a so-called texture mapping technique. As shown in 
Fig. 3, such an image synthesizing system separates image 
information relating to a 3-D object 310 represented as a 
shape model which comprises in combination with a plurality of 
polygons and graphic information to be applied to the polygons 
forming the shape model (hereinafter called "texture 
information") and stores the shape model and the graphic 
information. When an image is output, texture data 340, 342 
are applied to the respective polygons to synthesize the 
image. 

According to such a texture mapping technique, the 
patterns and colors of a graphic can be processed intricately 
without increasing the number of polygons to be processed. 

It is desirable that such a real-time display type image 
synthesizing system can synthesize a high-quality image while 
reducing the burden on the hardware. 

However, the image synthesizing system of the prior art 
has the following problems. 

First PrnhlPm 

As for the image synthesizing system of the prior art, if 
the quality of a graphic is to be improved, the amount of data 
processed by the hardware increases, and the number of objects 
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displayed per scene is limited. 

In the driving game, for example, vehicles running on a 
road, buildings arranged along the road and other scenery may 
be displayed as 3-D objects. Each of these 3-D objects is 
5 formed as a shape model which comprises in combination with a 
plurality of polygons. To increase the reality in the 3-D 
objects, the shape model must be represented by more 
combinations of polygons. 

In the computer graphics, however, the processing of 
10 polygons provides very high burden on the hardware. Therefore, 
as the number of polygons required to form one 3-D object 
multiplies, the burden on the hardware also increases. In 
displaying the image in real time, number of display objects 
per scene is so limited that the game scene can end up being 
15 monotonous. 

Second Problem 

In the driving game, a 3-D object may be enlarged 
partially and displayed as when a car approaches to another 
car. 

20 In such a case, if the texture data applied to the 

polygons have normal resolution, the enlarged display 3-D 
object is extremely degraded, and the reality in the game 
scene is damaged. 

If the texture information for the enlarged display 3-D 

25 object has high resolution, the memory capacity for storing 
the texture data becomes too big, making the entire system 
costly. 

For example, on improving the quality of enlarged display 
image in an image synthesizing system capable of displaying a 
30 racing car on a circuit from various angles, the shape model 
of a 3-D object representing the racing car must first be 
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formed by a number of polygons and the high-resolution texture 
information for all the polygons is prepared and stored in a 
memory. This rises the manufacturing cost of the entire 
system, resulting in an unreasonably expensive image 
5 synthesizer for game playing machines. 

In view of such problems, an object of the present 
invention is to provide an image synthesizing system which can 
form and display a 3-D object with less polygons of high 
resolution and a game playing apparatus using such an image 
10 synthesizing system. 

DISCLOSURE OF THE INVENTION 

To this end, the present invention provides an image 
synthesizing system comprising: 

3-D space processing means for perspecti vel y projecting 
15 a 3-D object representing a shape model formed by a 
combination of polygons in a virtual 3-D space onto a 
projection plane of view-point coordinate system; 

texture information storage means for previously storing 
texture information relating to images on the polygons of said 
20 3-D object; and 

image forming means for reading texture information 
corresponding to the polygons of said perspecti vel y projected 
3-D object from said texture information storage means by 
mapping said texture information onto the polygons for forming 
25 and displaying an image on a display, 

said 3-D space processing means comprising: 

an object data storage unit for storing data of said 3-D 
object as object data represented by a plurality of shape 
models having different degrees of precision; 
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an object data reading unit for selecting object data of 
a shape model of higher precision as said 3-D object and a 
view point draw closer to each other and for reading .said 
object data from said object data storage unit; and 
5 a 3-D calculation unit for positioning the read 3-D 

object in a virtual 3-D space and perspective! y projecting 
said 3-D object onto the projection plane of view-point 
coordinate system, 

said texture information storage means for storing 
10 texture information of each polygon forming respective shape 
models of different precision based on said shape models 
having different degrees of precision of said 3-D object,. and 
said image forming means for reading texture information 
of a shape model of precision corresponding to the polygons of 
15 said perspect i vel y projected 3-D object from said texture 
information storage means by mapping said texture information 
onto the polygons for synthesizing an image to be displayed. 

The present invention also provides a game playing 
apparatus compr i sing : 
20 a player's control unit; and 

an image synthesizing system responsive to input signals 
from said player's control unit and to a given game program 
for forming and displaying a game image on a display, 
said image synthesizing system comprising: 
25 3-D space processing means for perspective! y projecting 

a 3-D object representing a shape model formed by a 
combination of polygons in a virtual 3-D space onto a 
projection plane of view-point coordinate system; 

texture information storage means for previously storing 
30 texture information relating to images on the polygons of said 
3-D object ; and 
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image forming means for reading texture information 
corresponding to the polygons of said perspecti vel y projected 
3-D object from said texture information storage means by 
mapping the texture information onto the polygons for forming 
5 and displaying an image on a display, 

said 3-D space processing means comprising: 
an object data storage unit for storing data of said 3-D 
object as object data represented by a plurality of shape 
models having different degrees of precision; 
0 an object data reading unit for selecting object data of 

a shape model of higher precision as said 3-D object and a 
view point draw closer to each other and for reading said 
object data from said object data storage unit; and 

a 3-D calculation unit responsive to the input signals 
5 from the player's control unit and to the given game program 
for calculating a predetermined game and controlling said 
object data reading unit to read said object data, said 3-D 
calculation unit being further operative to position the read 
3-D object in a virtual 3-D space and perspecti vely project 
0 said 3-D object onto the projection plane of view-point 
coordinate system, 

Said texture information storage means for storing 
texture information of each polygon forming respective shape 
models of different precision based on said shape models 
5 having different degrees of precision of said 3-D object, and 
said image forming means for reading texture information 
of a shape model of precision corresponding to the polygons of 
said perspecti vely projected 3-D object from said texture 
information storage means by mapping said texture information 
0 onto the polygons for synthesizing an image to be displayed. 

It is preferred that said texture information storage 
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means stores highly resolute texture information for polygons 
in an image part requiring high resolution and a shape model 
of high precision. 

It is also preferred that said texture information 
5 storage means stores highly resolute texture information for 
polygons in an image part requiring high resolution. 

It is further preferred that said object data storage 
unit forms and stores an image part requiring high resolution 
for a shape model of high precision as independent polygons, 
10 and wherein said texture information storage means stores 
highly resolute texture information for polygons in an image 
part requiring high resolution. 

It is further preferred that said object data storage 
unit stores a predetermined 3-D object as object data 
15 represented by shape models for close-up-, middle-range and 
long-shot modes, and wherein said texture information storage 
means stores highly rbsolute texture information for polygons 
in an image part requiring high resolution of said close-up 
shape model . 

20 It is further preferred that said object data includes 

vertex texture coordinates set for each vertex in the 
respective polygons of said shape model, and wherein said 
image forming means calculates texture coordinates used as 
texture information read-out addresses for all dots in the 

25 polygons from input polygon vertex texture coordinates, the 
calculated texture coordinates being then used as addresses to 
read texture information from said texture information storage 
unit by mapping the read texture information onto the 
corresponding polygon for forming and displaying an image. 

30 According to the present invention, part or all of the 

3-D objects in the 3-D object data stored in the object data 
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storage unit are previously stored as object data representing 
a plurality of shape models having different degrees of 
precision. As the view point in the view-point coordinate 
system and the 3-D object draw closer, the object data 
represented by a shape model of higher precision is read out. 

If the 3-D object is far away from the view point, the 
3-D object is displayed as a simple shape model formed by less 
polygons. Thus, the burden on the hardware can be reduced and 
it is possible to display more 3-D objects on the display. 

Particularly, in a real-time computer graphic system in 
which the number of polygons to be displayed is limited, 
objects continuously changing their orientation and distance 
can be displayed with minimum number of polygons with the 
technique of the present invention. As a result, the image can 
be displayed in real time even if a scene requires many more 
pol ygons . 

in addition, it is preferred that the texture information 
applied to the polygons each forming a shape model of a 3-D 
object is stored as image data of different resolution for 
each shape model and further for each of the polygons forming 
the shape model, rather than all the texture information 
having the same resolution. 

In other words, the image synthesizing system of the 
present invention stores the texture information for each of 
the polygons forming each of the 3-D object shape models which 
have different degrees of precision. 

Among polygons forming a shape model , a polygon 
representing an image part requiring high resolution is formed 
to provide texture information of corresponding high 
resolution. Thus, with a shape model of high precision, the 
texture information corresponding to all polygons forming such 
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a shape model is stored as information of low resolution when 
an enlarged display object does not require very high 
resolution and as information of high resolution when an 
enlarged display object requires high resolution, rather than 
5 all the stored texture- i nformation having the same resolution. 
Therefore, the entire texture data can be compressed such that 
an image of high resolution can be displayed with little 
increase in the memory capacity for storing the texture 
information. 

10 When the present invention is applied to display a 3-D 

object constantly varying in orientation and distance in the 
3-D image space, the memory capacity used in the entire system 
can be saved more effectively. 

By applying the present invention to a game playing 

15 apparatus, it is possible to provide an inexpensive game 
apparatus which can display many 3-D objects. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of an image synthesizing system 
constructed in accordance with the embodiment of the present 
20 invention. 

Fig. 2 is a schematic view illustrating the principle of 
the image synthesizing system using a texture mapping 
technique. 

Fig. 3 is a view illustrating the principle of a texture 
25 mapping in the image synthesizing system of the embodiment. 

Figs. 4A, 4B and 4C illustrate various shape models of a 
3-D object used in the image synthesizing system of the 
embodiment . 

Figs. 5A, 5B and 5C illustrate game scenes formed by 
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using the shape models of Figs. 4A, 4B and 4C. 

Figs. 6A and 6B illustrate a close-up game scene formed 
by the shape models and the enlarged game scene thereof. 

Fig. 7 is a view illustrating a texture information 
5 storage unit used in. the image synthesizing system of the 
embodiment . 

Figs. 8A, 8B and 8C illustrate the details of texture 
information stored in the image synthesizing system of the 
embodiment . 

10 Fi9S - 9A and 9B illustrate the relationship between 

texture information used in a close-up model and positions of 
the model on which the texture information is applied. 

Fig. 10 illustrates the relationship between middle-range 
texture information and a shape model on which the texture 
15 information is applied. 

Fig. 11 illustrates the relationship between long-shot 
texture information and a shape model on which the texture 
information is applied. 

Fig. 12 illustrates the principle of a conventional image 
20 synthesizing system. 

BEST MODES FOR CARRYING OUT THE INVENTION 

The present invention will now be described , in detail 
with reference to the drawings. 

Fig. 2 shows one preferred embodiment of a real-time 
display type image synthesizing system constructed in 
accordance with the present invention, in which parts similar 
to those of the aforementioned prior art are designated by 
identical reference numerals. 

The image synthesizing system perspective! y projects a 
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3-D object 310 which is represented as a shape model 
comprising a combination of a plurality of polygons in a 
virtual 3-D space 300, onto a given perspective projection 
plane 316 in a view-point coordinate system. Thus, a pseudo 
5 3-D image 318 is displayed on a display. 

In such an image synthesis, the image synthesizing system 
uses a technique known as texture mapping. As shown in Fig. 3, 
the image information of the 3-D object 310 is separated into 
image information for respective polygons 320-1, 320-2, 320-3 

10 and so on and graphic information to be applied to the 
respective polygons (which is called "texture information 1 ' 
hereinafter) and is stored. When an image is to be output, 
texture information 340 and 342 are applied to the respective 
corresponding polygons 320-1, 320-2, 320-3 and so on so as to 

15 synthesize the - image. Such an application of the texture 
information 340 and 342 is accomplished after the 3-D object 
310 is perspective! y projected onto the projection plane. 

As described, the number of polygons which can be 
displayed in one second is limited to a certain degree when an 

20 image is to be displayed in real time through a 3-D computer 
graphic system. The present invention is characterized by that 
the rea.l-time display type .computer graphic system having 
limited number of polygons to be displayed in which a 3-D 
object continuously varying in orientation and distance can be 

25 displayed with less polygons and high resolution. 

Fig. 1 is a block diagram of an image synthesizing system 
to which the present invention is applied. 

The image synthesizing system comprises a player's 
control unit 10, a 3-D game space processing unit 20, a 

30 sorting unit 28 and an image synthesizing unit 30. The 
synthesized image is displayed on a display 40. 



The player's control unit 10 is located on a control 
panel 314 so that a player 312 may input various control 
signals. In a driving game, for example, the player's control 
unit 10 may include a steering wheel , brake pedal, accelerator 
pedal and others, all of which are disposed on and near the 
control panel 31 . 

The 3-D game space processing unit 20 is responsive to 
the input signals from the player's control unit 10 and to a 
previously stored game program for processing a game playing 
various 3-D objects 310 in a virtual 3-D space 300. 

Each of the 3-D objects 310 is represented as a shape 
model comprising a combination of a plurality of polygons. The 
3-D object 310 is perspective^ projected onto a perspective 
projection plane 316 in a moving view-point coordinate system, 
the information of the perspective! y projected 3-D object 
being then output toward the sorting unit 28. 

To accomplish such a processing, the game processing unit 
20 comprises a 3-D calculation unit 22, an object data reading 
unit 24 and an object data storage unit 26. 

The object data storage unit 26 stores image information 
of various 3-D objects represented as shape models each 
comprising a combination of a plurality of polygons. In this 
embodiment, particularly, 3-D object data representing racing 
cars played in various scenes are stored as plural, object data 
represented by a plurality of shape models having different 
degrees of precision. 

Figs. 4A, 4B and 4C show shape models of object data of 
a racing car which is to be stored in the object data storage 
unit 26. As shown in Figs. 4A, 4B and 4C, the object data 
storage unit 26 stores the object data for close-up, 
middle-range and long-shot modes, respectively. 
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The close-up object data shown in Fig. 4A represents the 
details of a racing car as a shape model 100A which is formed 
by a combination of polygons ranging between 200 and 300. 

The. close-up shape model 100A of the racing car is formed 
5 so that it looks natural from all directions since the angles 
of display is variable, for example, the racing car is 
displayed in various angles in a close-up position, as shown 
in Fig. 5A. 

In the close-up mode, particularly, the racing car may 

10 be partially enlarged and displayed, as shown in Fig. 6B. In 
such a case, any painted panel such as bonnet or the like is 
displayed natural when it is enlarged. However, when parts 
such as a number plate, head light and others are enlarged, 
they are displayed unnatural and poor with irregular edges. It 

15 is therefore preferred that such parts requiring high 
resolution are formed separately of other parts when shape 
models are to be formed. 1 

When the racing car is to be displayed relatively far 
from the view point as shown in Figs. 5B and 5C, - the area 

20 which the racing car occupies in the display is progressively 
reduced. Thus, a middle-range shape model 100B is formed of a 
combination of 20-30 polygons as shown in Fig. 4B, while a 
long-shot shape model 100C is formed of a simple hexahedron 
model comprising a combination of six polygons as shown in 

25 Fig. 4C. 

The 3-D calculation unit 22 is responsive to the given 
game program and to the input signals from the player's 
control unit 10 for performing various game calculations . 
Various 3-D objects such as racing cars, roads, buildings and 
30 other matters required to define the driving game are arranged 
in the virtual 3-D game space 300. 3-D objects to be displayed 



are specified in the view-point coordinate system. At the same 

tlB ' the distan « ^tween a racing car and the view point is 

calculated . 

The object data reading unit 24 sequentially reads object 
data calculated by the 3-D calculation unit 22 and to be 
displayed from the object data storage unit 26, the read 
object data is then input into the 3-D calculation unit 22 At 
this point, 3-D object data stored as a plura,ity of shape 
models having different degrees of precision (e g the 
aforementioned racing car) are selectively read out depending 
on the distance between the view point and the 3-D object in 
either of the close-up, middle-range or long-shot mode 

For example, when such an image as shown in Fig 5A is to 
he displayed, the object data formed by such a close-up shape 
model as shown in Fig. 5 A is read cut. When such a 
middle-range or long-shct image as shown in Fig. SB or 5C is 
to be displayed, the object data formed by such a middle-range 
or long-shot shape model as shown in Fig. 4B or 40 will be 
read out. 

The 3-D calculation unit 22 arranges the read 3-D object 
in the virtual 3-D game space 300, and perspective, y projects 
it onto the perspective projection plane 316 in the view-point 
coordinate system. The sorting circuit 28 sorts and outputs 
the information relating to the perspective^ projected 3-D 
object toward the image synthesizing unit 30. 

The structural and functional details of the 3-D game 
space processing unit 20 of the embodiment will be described 
m connection with texture information written into a texture 
information storage unit 32 which will be described later 

In the driving game according to this embodiment, image 
information of 3-D objects 3,0 representing various game 
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defining components such as racing cars, roads, buildings or 
the like are stored in the 3-D object data storage unit 26. 
The image information of these 3-D objects are then subjected 
to various image processing steps such as coordinate 
5 transformation, rotation, translation and so on. Thus, the 
driving game space 300 being the virtual 3-D game space is 
formed . 

The 3-D game space processing unit 20 causes each polygon 
(more particularly, each vertex thereof) to be subjected to 

10 various processing steps such as coordinate transformations 
such as rotation, translation, perspective projection and 
others and clipping. The texture information is processed by 
the 3-D game space processing unit 20 separately of the 
polygons. The texture information itself is stored in the 

15 texture information storage unit 32 which will be described 
later. The texture information is specified by giving image 
information of vertex texture coordinates VTX and VTY to each 
vertex in each polygon. For example, as shown in Fig. 2, each 
of the vertices in the polygon 320-1 is previously given 

20 vertex texture coordinates (VTX0, VTYO) , (VTX1 , VTY1 ) , (VTX2, 
VTY2) and (VTX3, VTY3) . These vertex texture coordinates are 
stored in the 3-D object data storage unit 26. 

The 3-D calculation unit 22 is responsive to the given 
game program and to the input signals from the player's 

25 control unit 10 for performing various game processing steps.. 
To form a driving game space 300, for example, various 3-D 
objects 310 defining such driving game components as racing 
cars, roads, buildings and so on must be arranged in place in 
the virtual 3-D game space 300. Therefore, an object number 

30 and positional information indicating the position of any 
specified 3-D object are required, and are calculated by the 
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3-D calculation unit 22. 

For such a particular object, for example, a racing car 
controlled by the player, the 3-D calculation unit 22 uses the 
distance between the view point and the object to determine 
which object data of the close-up, middle-range or long-shot 
shape model as shown in Fig. 4 should be read out and to 
output the object number of the read object data. 

The object data reading unit 24 reads the image 
information of the corresponding 3-D object from the 3-D 
object data storage unit 26 using the object number as 
address . 

The 3-D calculation unit 22 forms object data and polygon 
data from the data read from the 3-D object data storage unit 
26 . 

The object data is formed by positional data, rotation 
data and other associated data for 3-D objects such as racing 
cars and others. The polygon data is formed b;y data divided 
from the image information of the racing cars and others and 
includes polygon vertex coordinates, vertex texture 
coordinates, brightness information and other associated data 
Such data is formatted into a given style. 

The 3-D calculation unit 22 uses the player's view point 
data and the object data to perform various coordinate 
transformations to the polygon data, in other words, the 
Polygon is subjected to rotation into the local coordinate 
system, translation into the world coordinate system and 
rotation into the view-point coordinate system. 

After these coordinate transformations, the polygon data 
is then subjected to clipping. The clipped data is then output 
toward a subsequent sorting unit 28. 

The sorting unit 28 uses the data thus input and sorting 
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data contained in the input data to determine the order of 
image information of the polygon to be processed in the 
subsequent image synthesizing unit 30. According to the 
determined order , the. image information of each polygon is 

5 output toward the image synthesizing unit 30. 

The image synthesizing unit 30 comprises a texture 
information storage unit 32 which stores the texture 
information of the respective polygons and an image forming 
unit 34 for mapping the texture information stored in the 

10 texture information storage unit 32 on the respective polygons 
of the perspect i vel y projected 3-D object so as to form an 
image to be displayed. 

Fig. 7 schematically shows the texture storage plane of 
the texture information storage unit 32. The texture storage 

15 plane is divided into a plurality of blocks each of which is 
divided into 256x256 characters. Each of the characters is 
further divided into 16x16 dot pixels and stores a picture 
element used to form the texture storage plane. 

The texturing to each polygon is accomplished by 

20 specifying the coordinates TX and TY of . each texture 
information which is to be applied to a polygon. However, a 
polygon spanning between adjacent blocks cannot be specified. 

Fig. 8 shows the details of the racing car texture 
information which is stored in the texture information storage 

25 unit 32 of such a structure. Fig. 8A shows the texture 
information to be applied to the respective polygons for 
forming the close-up. shape model shown in Fig. 4A; Fig. 8B 
shows the texture information to be applied to the respective 
polygons for forming the middle-range shape model; and Fig. 8C 

30 shows the texture information to be applied to the respective 
polygons for forming the long-shot shape model. 
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The texture information shown in Fig. 8 A i s formed to 
represent parts corresponding to the respective polygons in 
the close-up shape model. The texture information 200, 202 
204, 206, 208, 210, 212, 214 and 216 is stored to represent, 
front mask and winkers, tail end, number plate, opposite side 
windows, rear lamps, road wheels, doors and painted panels and 
so on, respectively. 

In the middle-range texture information shown in Fig SB 
the texture information 230. 232, 234, 236, 238 and 240 
represent side windows, windshie ld , side view, front view 
rear v,ew and painted panels and so on, respectively. 

The long-shot texture information shown in Fig sc is 
formed in a manner similar to those of Figs. 8A and 88. 

Fi9. 9 shows the relationship between the close-up 
texture information and the racing car formed by applying this 
texture information. Figs. , 0 and respectively show the 
relationships between the middle-range and long-shot texture 
information and the racing cars formed by a pp, ying the8e 
texture information. 

As shown in Fig. 5 , the area which the 3-D object 
occupies on the display 40 progressively decreases as the 3-D 
object moves farther from the view point. Thus, the texture 
information used therein can be of progressively reduced 
resolut,on. This embodiment reduces the amount of data to be 
Processed and saves the memory area by displaying highly 
resolute 3-D objects in the close-up mode and low resolute 3-D 
objects in the middle-range and long-shot modes, as shown in 
Fig. 8. 

in addition, this embodiment does not form all the close- 
UP texture information shown in Fig. 8 A as data of the same 
resolution, but only forms the texture information 
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representing parts requiring high resolution as high 
resolution data when the racing car is partially enlarged and 
displayed as shown in Fig. 6B. In other words, as shown in 
Fig. 8A, the close-up texture information provides larger 
5 highly resolute graphics to the enlarged part and finely drawn 
parts of the racing car. Other parts are formed as texture 
information representing smaller graphics of lower resolution. 
These texture information are stored in the texture 
information storage unit 32. Thus, the 3-D objects can be 

10 displayed with high resolution while further saving the memory 
required by the texture information storage unit 32. 

Among the polygons forming the middle-range and long-shot 
shape models, any polygon requiring high resolution may be 
formed- as highly resolute texture information, if desired. 

15 The image forming unit 34 is responsive to the image 

information of 3-D object input from the 3-D calculation unit 
22 through the sorting unit 28 for reading texture information 
corresponding to the respective polygons of the perspective! y 
projected 3-D object from the texture information storage unit 

20 32, and for mapping them on the polygons to form an image to 
be displayed on the display 40. 

The texture mapping in the image forming unit 34 will be 
described in more detail. 

The image forming unit 34 calculates the outline and 

25 internal image information of each polygon from its vertex 
image information which is input into the image forming unit 
34 from the 3-D calculation unit 22 through the sorting unit 
28. In other words, the 3-D calculation unit 22 and the 
sorting unit 28 must perform various complicated calculations 

30 such as coordinate transformations including rotation, 
translation and others, clipping, sorting and so on. To reduce 
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the burden on the hardware, all the calculations are made for 
every polygon and for every vertex. The outline and internal 
image information of the polygons required to perform the 
actual image display are formed by the image forming unit 34. 

At this point, the image forming unit 34 determines 
texture, coordinates TX and TY used as texture information 
reading addresses from the respective vertex texture 
coordinates VTX and VTY to be input for all the dots in each 
polygons. These texture coordinates TX and TY are used to 
address the corresponding texture information in the texture 
information storage unit 32, the read texture information 
being then mapped to synthesize and display an image of 3-D 
object on the display 40. Such an image synthesizing technique 
through the texture mapping is proposed in Japanese Patent 
Application No. 4-252139 filed by the applicant. 

Fig. 5 shows the details of scenes which are displayed on 
the display 40 through the image synthesizing system of this 
embodiment. Fig. 5A shows a racing car located at the close 
range from the view point; Fig. 5B shows the same racing car 
located at the middle range; and Fig. 5C shows the same racing 
car located at the long range. Each of the racing car images 
shown in Figs. 5A, 5B and 5C is formed by mapping such texture 
information as shown in Figs. 8A, 8B and 8C onto the polygons 
of such shape models as shown in Figs. 4A, 4B and 4C, 
respectively, as shown in Figs. 9, 10 and 11. 

The image synthesizing system of this embodiment uses 
such a highly precise shape model as shown in Fig. 4A when the 
racing car is displayed in the close-up mode as shown in Fig. 
5A and applies such highly resolute texture information as 
shown in Fig. 8A to the shape model to perform the image 
synthesis. Therefore, the resulting image of the racing car is 



extremely realistic and clear. 

When the close-up racing car is partially enlarged and 
displayed as shown in Fig. 6B, its number plate, front view 
and other parts can be displayed with improved quality since 
they are formed from the highly resolute texture information 
compare to the other parts. 

In addition, when the racing car is displayed in the 
long-range modes as shown in Figs. 5B and 5C, the image is 
formed and displayed by such relatively simple shape models as 
shown in Figs. 4B and 4C and yet by using such texture 
information of lower resolutions as shown in Figs. 8B and 8C 
since the area of the racing car occupying the display may be 
small, thus, the number of calculation steps in the hardware 
can be reduced while saving the memory area. 

According to the image synthesizing system of this 
embodiment, the number of polygons used as well as the memory 
area required by the texture information storage unit may be 
saved while representing any moving object such as car 
real i st i cal 1 y . 

The present invention is not limited to the 
aforementioned embodiment, but may be applied in any one of 
various modifications and changes within the scope . of the 
i nvention . 

For example, the texture information exclusive to the 
shape model of different degrees of precision may be replaced 
by texture information shared by some of the polygons in the 
respective shape models. 

Although the embodiment of the present invention is 
described as to the image synthesizing system used in the game 
playing apparatus, the present invention may be similarly 
applied to 3-D image generating simulators and other 
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simulators . 

The texture information mapping to the polygons may be 
replaced by any other mapping techniques, if necessary. 

Although the embodiment is described as to the display of 
a single 3-D object (racing car in this embodiment) through 
the technique of the present invention, the present invention 
may be applied to synthesize and display a plurality of 3-D 
objects on the display through the same technique. 

As described, the present invention is effective to 
provide a high-resolution and real-time display type image 
synthesizing system and a game playing apparatus using an 
image synthesizing system which can display the 3-D objects 
continuously changing in orientation and distance while 
reducing the burden on the hardware. 

When the image synthesizing system of the present 
invention is used in a game playing apparatus, various moving 
3-D objects can be displayed effectively so as to provide 
improved dramatic scenes. 
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CLAIMS 

1. An image synthesizing system comprising: 

3-D space processing means for perspecti v.ely projecting 

a 3-D object representing a shape model formed by a 
5 combination of polygons in a virtual 3-D space onto a 

projection plane of view-point coordinate system; 

texture information storage means for previously storing 

texture information relating to images on the polygons of said 

3-D object; and 

10 image forming means for reading texture information 

corresponding to the polygons of said perspect i vel y projected 
3-D object from said texture information storage means by 
mapping said texture information onto the polygons for forming 
and displaying an image on a display, 

15 said 3-D space processing means comprising: 

an object data storage unit for storing data of said 3-D 
object as object data represented by a plurality of shape 
model s - havi ng different degrees of precision; 

an object data reading unit for selecting object data of 

20 a shape model of higher precision as said 3-D object and a 
view point draw closer to each other and for reading said 
object data from said object data storage unit; and 

a 3-D calculation unit for positioning the read 3-D 
object in a virtual 3-D space and perspect i vel y projecting 

25 said. 3-D object onto the projection plane of view-point 
coordinate system, 

said texture information storage means for storing 
texture information of each polygon forming respective shape 
models of different precision based on said shape models 

30 having different degrees of precision of said 3-D object, and 
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said image forming means for reading texture information 
of a shape model of precision corresponding to the polygons of 
said perspectives projected 3-D object from said texture 
information storage means by mapping said texture information 
onto the polygons for synthesizing an image to be displayed. 

2. An image synthesizing system as defined in claim 1 
wherein said texture information storage means stores highly 
resolute texture information for polygons in an image part 
requiring high resolution and a shape model of high precision. 

3. An image synthesizing system as defined in claim 1 
wherein said texture information storage means stores highly 
resolute texture information for polygons in an image part 
requiring high resolution. 

4. An image synthesizing system! as defined in claim 1 
wherein said object data storage unit forms and stores an 
image part requiring high resolution for a. shape model of high 
precision as independent polygons, and wherein said texture 
information storage means stores highly resolute texture 
information for polygons in an image part requiring high 
resolution. 



5. An image synthesizing system as defined in claim 1 
wherein said object data storage unit stores a predetermined 
3-D object as object data represented by shape models for 
close-up, middle-range and long-shot modes, and wherein said 
texture information storage means stores highly resolute 
texture information for polygons in an image part requiring 
high resolution of said close-up shape model. 
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6. An image synthesizing system as defined, in claim 1 
wherein said object data includes vertex texture coordinates 
set for each vertex in the respective polygons of said shape 
model, and wherein said image forming means calculates texture 
coordinates used as texture information read-out addresses for 
all dots in the polygons from input polygon vertex texture 
coordinates, the calculated texture coordinates being then 
used as addresses to read texture information from said 
texture information storage unit by mapping the read texture 
information onto the corresponding polygon for forming and 
displaying an image. 

7. An image synthesizing system as. defined in claim 2 
wherein said object data includes vertex texture coordinates 
set for each vertex in the respective polygons of said shape 
model, and wherein said image forming means calculates texture 
coordinates used as texture information read-out addresses for 
all dots in the polygons from input polygon vertex texture 
coordinates,, the calculated texture coordinates being then 
used as addresses to read texture information from said 
texture information storage unit by mapping the read texture 
information onto the corresponding polygon for forming and 
displaying an image. 

8. An image synthesizing system as defined in claim 3 
wherein said object data includes vertex texture coordinates 
set for each vertex in the respective polygons of said shape 
model, and wherein said image forming means calculates texture 
coordinates used as texture information read-out addresses for 
all dots in the polygons from input polygon vertex texture 
coordinates, the calculated texture coordinates being then 



used as addresses to read texture information from said 
texture information storage unit by mapping the read texture 
^formation onto the corresponding polygon for forming and 
displaying an image. 



9- An ,mage synthesizing system as defined in claim 5 
wherein said object data includes vertex texture coordinates 
set for each vertex in the respective polygons of said shape 
model, and wherein said image forming means ca lo ulates texture 
coordinates used as texture information read-out addresses for 
all dots in the polygons from input polygon vertex texture 
coordinates, the calculated texture coordinates being then 
used as addresses to read texture information from said 
texture information storage unit by mapping the read texture 
information onto the corresponding polygon for forming and 
displaying an image. 

10. A game playing apparatus comprising: 
a player's control unit; and 

an image synthesizing system responsive to input signals 
from said player's control unit and to a given game program 
for forming and displaying a game image on a display, 
said image synthesizing system comprising: 
3-D space processing means for perspecti vel y projecting 
a 3-D object representing a shape model formed by a 
combination of polygons in a virtual 3-D space onto a 
Projection plane of view-point coordinate system; 

texture information storage means for previously storing 
texture information relating to images on the polygons of said 
3-D object; and 

image forming means for reading texture information 
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cor respondi ng to the polygons of said perspective! y projected 
3-D object from said texture information storage means by 
mapping the texture information onto the polygons for forming 
and displaying an image on a display, 
5 said 3-D space processing means comprising: 

an object data storage unit for storing data of said 3-D 
object as object data represented by a plurality of shape 
models having different degrees of precision; 

an object data reading unit for selecting object data of 

10 a shape model of higher precision as said 3-D object and a 
view point draw closer to each other and for reading said 
object data from said object data storage unit; and 

a 3-D calculation unit responsive to the input signals 
from the player's control unit and to the given game program 

15 for calculating a predetermined game and controlling' said 
object data reading unit to read said object data, said 3-D 
calculation unit being further operative to position the readl 
3-D object in a virtual 3-D space and pe rspect i vel y project 
said 3-D object onto the projection plane of view-point 

20 coordinate system,. 

said texture information storage means for storing 
texture information of each polygon forming respective shape 
models of different precision based on said shape models 
having different degrees of precision of said 3-D object, and 

25 said image forming means for reading texture information 

of a shape model of precision corresponding to the polygons of 
said perspecti vel y projected 3-D object from said texture 
information storage means by mapping said texture information 
onto the polygons for synthesizing an image to be displayed. 

30 11. A game playing apparatus as defined in claim 10 wherein 
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said texture information storage means stores highly resolute 
texture information for polygons in an image part requiring 
high resolution and a shape model of high precision. 

12. An image synthesizing system as defined in claim 10 
wherein said texture information storage means stores highly 
resolute texture information for polygons in an image part 
requiring high resolution. 

13. An image synthesizing system as defined in claim 10 
wherein said object data storage unit forms and stores an 
image part requiring high resolution for a shape model of high 
precision as independent polygons, and wherein said texture 
information storage means stores highly resolute texture 
information for polygons in an image part requiring high 
resolution. 

14. An image synthesizing system as defined in claim 10 
wherein said object data storage unit stores a predetermined 
3-D object as object data represented by shape models for 
close-up, middle-range and long-shot modes, and wherein said 
texture information storage means stores highly resolute 
texture information for polygons in an image part requiring 
high resolution of said close-up shape model. 

15. An image synthesizing system as defined in claim 10 
wherein said object data includes vertex texture coordinates 
set for each vertex in the respective polygons of said shape 
model, and wherein said image forming means calculates texture 
coordinates used as texture information read-out addresses for 
all dots in the polygons from input polygon vertex texture 
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coordinates, the calculated texture coordinates being then 
used as addresses to read texture information from said 
texture information storage unit by mapping the read texture 
information onto the corresponding polygon for forming and 
5 displaying an image. 

16.. An image synthesizing system as defined in claim 11 
wherein said object data includes vertex texture coordinates 
set for each vertex in the respective polygons of said shape 
model, and wherein said image forming means calculates texture 

10 coordinates used as texture information read-out addresses for 
all dots in the polygons from input polygon vertex texture 
coordinates, the calculated texture coordinates being then 
used as addresses to read texture information from said 
texture information storage unit by mapping the read texture 

15. information onto the corresponding polygon for forming and 
displaying an image. i 

17. An image synthesizing system as defined in claim 12 
wherein said object data includes vertex texture coordinates 
set for each vertex in the respective polygons of said shape 

20 model, and wherein said image forming means calculates texture 
coordinates used as texture information read-out addresses for 
all dots in the polygons from input polygon vertex texture 
coordinates, the calculated texture coordinates being then 
used as addresses to read texture information from said 

25 texture information storage unit by mapping the read texture 
information onto the corresponding polygon for forming and 
displaying an image. 

18. An image synthesizing system as defined in claim 14 
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wherein said object data incudes vertex texture coordinates 
set for each vertex in the respective polyps cf said shape 
mode,, and wherein said image forming means calculates texture 
coordinates used as texture information read-out addresses for 
a,l dots in the polygons from input polygon vertex texture 
coordinates, the c al cu,ated texture coordinates being then 
used as addresses to read texture information from said 
texture information storage unit by mapping the read texture 
information onto the corresponding polygon for forming and 
displaying an image. 
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